A Substitute Vision System for Providing 3D Perception and GPS Navigation via Electro-Tactile Stimulation
نویسنده
چکیده
This paper describes a novel approach for enabling the blind to achieve obstacle avoidance and navigation in outdoor environments with the aid of visual sensors, GPS and electro-tactile stimulation. The electro-neural vision system (ENVS) works by extracting a depth map from stereo cameras by measuring the disparity between the stereo images. This range data is then delivered to the fingers via electro-neural stimulation to indicate to the user the range of objects being viewed by the cameras. To perceive the location of obstacles and the 3D structure of the environment the user imagines that the hands are held in the direction viewed by the cameras, with fingers extended, and the amount of stimulation felt by each finger indicates the range of objects in the direction pointed at by each finger. Also, the relative location of significant landmarks is determined using GPS and stored GPS coordinates and delivered to the fingers via encoded pulses when the landmarks are in the field of view of the stereo cameras. This intuitive means of perceiving the 3D structure of the environment and the location of landmarks in real time effectively enables the user to navigate the environment without use of the eyes or other blind aids. Experimental results are provided demonstrating the potential that this form of 3D environment perception has at enabling the user to achieve localisation, obstacle avoidance and navigation without using the eyes.
منابع مشابه
A Vision System for Providing the Blind with 3d Colour Perception of the Environment
Although various attempts have been made at providing the blind with substitute visual perception, no existing method provides useful colour perception of the environment. This paper describes a substitute vision system which provides perception of the three-dimensional profile and colour of the surrounding environment via haptic sensations alone. This is aimed at allowing visually-impaired peo...
متن کاملSubstitute Three-Dimensional Perception using Depth and Colour Sensors
The development of sensor-actuator systems that can provide the user with perception of the environment without any use of the eyes is a difficult task. Firstly, the sensors must work effectively under differing conditions. Secondly, the actuators (or auditory feedback) must present the environmental information to the user in a manner that is easy to understand. Thirdly, the whole system needs...
متن کاملIntelligent Glasses: A New Man-Machine Interface Concept Integrating Computer Vision and Human Tactile Perception
This paper introduces a new re-programmable interface concept, the Intelligent Glasses (IG): an association of physiological human inspired machine vision and tactile stimulation for 3D (static and dynamic) world representation. The IG interface concept is used to design a wearable system to facilitate navigation and assist mobility of the low vision/sightless in 3D non-cooperating environments...
متن کاملThe ViibraCane - A White Cane for Tactile Navigation Guidance
During previous CSUN conferences we presented the navigation system TANIA (Tactile-Acoustical Navigation and Information Assistant). The system’s main component is an Ultra Mobile PC and it achieves positioning of the user via an accurate step-tracking method, GPS, and RFID tags, and works both indoors and outdoors. Besides providing information about the surrounding area by an integrated tacti...
متن کاملPerception for UAV: Vision-Based Navigation and Environment Modeling
Nowadays, cameras and other exteroceptive sensors are on board of a large variety of automatic platforms, such as Unmanned Aerial Vehicles (UAV), space exploration probes and missiles. However, apart from this latter application, they are mostly used as payload and not to pilot the vehicle itself. In this paper, we focus on the use of computer vision for UAV perception to navigate through the e...
متن کامل